Estimating snow cover from publicly available images

In this paper we study the problem of estimating snow cover in mountainous regions, that is, the spatial extent of the earth surface covered by snow. We argue that publicly available visual content, in the form of user generated photographs and image feeds from outdoor webcams, can both be leveraged as additional measurement sources, complementing existing ground, satellite and airborne sensor data. To this end, we describe two content acquisition and processing pipelines that are tailored to such sources, addressing the specific challenges posed by each of them, e.g., identifying the mountain peaks, filtering out images taken in bad weather conditions, handling varying illumination conditions. The final outcome is summarized in a snow cover index, which indicates for a specific mountain and day of the year, the fraction of visible area covered by snow, possibly at different elevations. We created a manually labelled dataset to assess the accuracy of the image snow covered area estimation, achieving 90.0% precision at 91.1% recall. In addition, we show that seasonal trends related to air temperature are captured by the snow cover index.Comment: submitted to IEEE Transactions on Multimedi

A Data Set and a Convolutional Model for Iconography Classification in Paintings

Iconography in art is the discipline that studies the visual content of artworks to determine their motifs and themes andto characterize the way these are represented. It is a subject of active research for a variety of purposes, including the interpretation of meaning, the investigation of the origin and diffusion in time and space of representations, and the study of influences across artists and art works. With the proliferation of digital archives of art images, the possibility arises of applying Computer Vision techniques to the analysis of art images at an unprecedented scale, which may support iconography research and education. In this paper we introduce a novel paintings data set for iconography classification and present the quantitativeand qualitative results of applying a Convolutional Neural Network (CNN) classifier to the recognition of the iconography of artworks. The proposed classifier achieves good performances (71.17% Precision, 70.89% Recall, 70.25% F1-Score and 72.73% Average Precision) in the task of identifying saints in Christian religious paintings, a task made difficult by the presence of classes with very similar visual features. Qualitative analysis of the results shows that the CNN focuses on the traditional iconic motifs that characterize the representation of each saint and exploits such hints to attain correct identification. The ultimate goal of our work is to enable the automatic extraction, decomposition, and comparison of iconography elements to support iconographic studies and automatic art work annotation.Comment: Published at ACM Journal on Computing and Cultural Heritage (JOCCH) https://doi.org/10.1145/345888

Business Process Modeling and Quick Prototyping with WebRatio BPM

We describe a software tool called WebRatio BPM that helps close the gap between the modeling of business processes and the design and implementation of the software applications that support their enactment. The main idea is to enhance the degree of automation in the conversion of business process models into application models, defined as abstract, platform-independent representations of the application structure and behavior. Application models are themselves amenable to the semiautomatic transformation into application code, resulting in extremely rapid prototyping and shorter time-to-market. Thanks to the proposed chain of model transformations it is also possible to fine tune the final application in several ways, e.g., by integrating the visual identity of the organization or connecting the business process to legacy applications via Web Services

SnowWatch: A multi-modal citizen science application

The demo presents Snow Watch, a citizen science system that supports the acquisition and processing of mountain images for the purpose of extracting snow information, predicting the amount of water available in the dry season, and supporting a multi-objective lake regulation problem. We discuss how the proposed architecture has been rapidly prototyped using a general-purpose architecture to collect sensor and user-generated Web content from heterogeneous sources, process it for knowledge extraction, relying on the contribution of voluntary crowds, engaged and retained with gamification techniques

Almost Rerere: Learning to resolve conflicts in distributed projects

The concurrent development of applications requires reconciling conflicting code updates by different developers. Recent research on the nature of merge conflicts in open source projects shows that a significant fraction of merge conflicts have limited size (one or two lines of code) and are resolved with simple strategies that use code present in the merged versions. Thus the opportunity arises of supporting the resolution of merge conflicts automatically by learning the way in which developers fix them. In this paper we propose a framework for automating the resolution of merge conflicts which learns from the resolutions made by developers and encodes such knowledge into conflict resolution rules applicable to conflicts not seen before. The proposed approach is text-based, does not depend on the programming languages of the merged files and exploits a well-known and general language (search and replacement regular expressions) to encode the conflict resolution rules. Evaluation results on 14,872 conflicts from 25 projects show that the system can synthesize a resolution for 49% of the conflicts occurred during the merge process (89% if one considers conflicts that have at least one similar conflict in the data set) and can reproduce exactly the same solution that human developers have applied in 55% of the cases (62% for single line conflicts)

Convolutional neural network for pixel-wise skyline detection

Outdoor augmented reality applications are an emerging class of software systems that demand the fast identification of natural objects, such as plant species or mountain peaks, in low power mobile devices. Convolutional Neural Networks (CNN) have exhibited superior performance in a variety of computer vision tasks, but their training is a labor intensive task and their execution requires non negligible memory and CPU resources. This paper presents the results of training a CNN for the fast extraction of mountain skylines, which exhibits a good balance between accuracy (94,45% in best conditions and 86,87% in worst conditions), memory consumption (9,36 MB on average) and runtime execution overhead (273 ms on a Nexus 6 mobile phone), and thus has been exploited for implementing a real-world augmented reality applications for mountain peak recognition running on low to mid-end mobile phones

Heterogeneous information integration for mountain augmented reality mobile apps

Mobile Augmented Reality (AR) applications offer a new way to promote the collection of geo-referenced information, by engaging citizens in a useful experience and encouraging them to gather environment data, such as images of plant species or of mountain snow coverage. The distinctive characteristic of mobile AR applications is the overlay of information directly on top of what the user sees, based on the user’s context estimated from the device sensors. The application analyzes the sensor readings (GPS position, phone orientation and motion, and possibly also the camera frame content), to understand what the user is watching and enriches the view with contextual information. Developing mobile AR applications poses several challenges related to the acquisition, selection, transmission and display of information, which gets more demanding in mountain applications where usage without Internet connectivity is a strong requirement. This paper discusses the experience of a real world mobile AR application for mountain exploration, which can be used to crowdsource the collection of mountain images for environmental purposes, such as the analysis of snow coverage for water availability prediction and the monitoring of plant diseases